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Taxonony,  Descriptions,  and  Individuals  in 
Natural  Language  Understanding* 


Ronald  J,  Rrachman 


KLONE  is  a  gen. r  a  1-pur  pose  language  for  representing 
conceptual  Information.  N.veral  of  Its  prominent  features  - 
semantically  clean  Inheritance  of  structured  descriptions, 
taxonomic  classification  of  generic  knowledge,  intension,! 
structures  for  functional  roles  (including  the  possibility  of 
multiple  fillers) ,  snd  procedural  attachment  (with  automatic 
invocation)  -  make  it  particularly  useful  in  computer-based  natural 
language  understanding.  we  have  Implemented  a  prototype  natural 
language  system  that  uses  KLONE  extensively  in  several  facets  of 
its  operation.  This  report  describes  the  system  and  points  out  how 
it  uses  KLONE  for  , opr esenr at  I  on  In  natural  language  process. ng. 


Our  system  1,  the  beneficiary  of  two  kinds  of  advantage  from 
KLONE,  First,  the  taxonomic  character  of  the  structured 
inheritance  net  facilitate,  the  processing  Involved  in  analyztn, 
and  respond  1 ng  to  an  utterance.  In  particular,  (1)  It  helps  guide 
parsing  by  ruling  out  semantically  meaningless  paths,  (2)  It 
prov Ides  .  general  way  of  organizing  and  Invoking  semantic 
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interpretation  rules,  and  (3)  it  allows  algorithmic  determination 
of  equivalent  sets  of  entities  for  certain  pi  an- i ecogn i t ion 
inferences.  Second,  KLONE's  representational  structure  captures 
some  of  the  subtleties  of  natural  language  expression.  That  is,  it 
provides  a  general  way  of  representing  exactly  the  quant i f i cat iona 1 
import  of  a  sentence  without  over-committing  the  interpretation  to 
scope  or  multiplicity  not  overtly  specified. 

In  this  report,  we  first  present  a  brief  overall  description 
of  the  natural  language  system.  Then,  prior  to  describing  how  we 
use  KLONE  in  the  system,  we  discuss  some  of  the  language's  features 
at  a  general  level.  Finally,  we  look  in  detail  at  how  KLONE 
affords  uc  the  advantages  listed  above, 

1 .  The  Task  and  the  Systen 

Our  general  task  is  to  provide  a  natural  interface  to  an 
intelligent  display  system  in  a  command  and  control  environment. 
The  component  of  our  systen  that  manipulates  the  (bi^-map)  display 
the  'Advanced  Information  Presentation  System*  (AIPS) 
represents  explicitly  (in  KLONE!  all  objects  {ships,  etc.)  to  be 
presented,  their  presentation  forms  (circles,  text,  etc.), 
descriptions  of  view  surfaces  on  which  to  project  presentations  of 
the  objects,  and  coordinate  mappings  between  those  surfaces.  This 
explicit  representation  allows  the  user  to  flexibly  alter  at  will 
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the  picture  s/he  sees  by  adding  or  moving  display  windows,  changing 
size,  shape,  etc.  of  display  forms,  and  adding  and  removing  objects 
or  object  detail.  The  user  changes  the  subject  and  form  of  what 
s/he  sees  by  describing  what  s/he  wants  displayed. 

In  the  particular  system  to  be  described  in  this  report,  we 
have  taken  as  our  domain  of  discourse  the  Augmented  Transition 
Network  (ATN)  Grammar  from  the  LUNAR  natural  language  understanding 
system  [Woods,  Kaplan  and  Nash-Webber,  1972).  Thus,  the  objects  to 
be  displayed  are  the  states  and  arcs  of  the  ATN,  including  state 
names,  arc  types,  conditions,  actions,  etc.  Cur  particular  display 
setup  has  three  windows  -  for  prompts,  text  interaction,  and 
grammar  display.  At  the  moment,  the  size  and  placement  of  these 
windows  is  fixed;  but  these  could  be  easily  changed  using  the  AIP3 
f ac  i  1  i  ty . 

<he  addition  of  a  natural  language  interface  to  AJpg  yields 
more  than  just  a  convenient  way  to  state  explicit  display  changes. 
Now  the  display  'an  be  altered  in  response  to  a  question  {e.g,, 
highlighting  a  ship  to  mean  "there!"  in  response  to  a  "where* 
question),  or  to  an  indirect  speech  act  ie.g.,  "I  want  to  see  it" 
produces  a  display  of  the  appropriate  object).  Further,  natural 
language  provides  a  convenient  way  to  express  standing  orders  of 
various  types  (e.g.,  "Display  ships  with  radar  as  flashing 
triangles";  "whenever  three  ships  are  in  the  same  convoy,  and 
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within  ft  miles  of  each  other,  use  a  single  task  force  symbol  to 
stand  for  the  set  of  ships"). 

A  simple  dialogue  will  serve  to  show  the  blend  of  natural 
language  and  intelligent  knowledge-based  graphics  that  we  envision 
in  the  command  and  control  environment  (note  the  use  of 
use r- po  i nt 1 ng  input  as  well  as  language): 

1)  Show  me  the  clause  level  network. 

[System  displays  states  and  arcs  of  the  S/  network) 

2)  Show  me  5/NP. 

(System  highlights  state  S/NP] 

1)  Focus  in  on  the  preverbal  constituents. 

[System  shifts  scale  and  centers  the  display  on  the 
preverbal  states] 

4)  No,  I  want  to  he  able  to  see  S/A’JX. 

[System  "backs  off"  display  so  as  to  include  state 
S/AUX] 

*■ )  Remove  the  highlight  from  this  <user  po  i  n  t  s  >  state. 
(System  remove'-  highlight  from  S/NP) 

At  the  same  time,  we  would  like  to  ask  factual  questions  about 
the  states,  arcs,  etc.  of  the  A7N  (e.g.,  "What  are  the  conditions 
on  this  <user  points}  arc?").  Questions  and  commands  addressed  to 
the  system  typically  (1)  make  use  of  elements  of  the  preceding 
dialogue,  {2}  can  be  expressed  indirectly  so  that  the  surface  form 
does  not  reflect  the  real  intent,  and  (3)  given  our  graphical 
presentation  system,  can  make  reference  to  a  shared  non- 1 i ng ui st i c 
'.text.  The  issues  of  anaphora,  (indirect)  speech  acts,  and 

deixis  are  thus  of  principal  concern. 
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1.1  Systea  Organisation 

The  natural  language  system  is  organized  as  illustrated  in 
Figure  1,  The  user  sits  at  a  bit-map  terminal  equipped  with  a 
keyboard  and  a  pointing  device.  Typed  input  from  the  keyboard 
(possibly  interspersed  with  coordinates  from  the  pointing  device) 
is  analyzed  by  a  version  of  the  RllS  Systea  (Bobrow,  1978)  -  an 

ATN-based  incremental  parser  that  is  closely  coupled  with  a 
■case-frame  dictionary*.  In  our  system,  this  dictionary  is 
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Figure  1.  System  structure 
(highlighting  types  of  knowledge  involved) . 
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embodied  in  a  syntactic  taxonomy  represented  in  KLONE.  The  parser 
produces  a  KLONE  representation  of  the  syntactic  structure  of  an 
utterance.  Incrementally  along  with  its  production,  this  syntactic 
structure  triggers  the  creation  of  an  interpretation.  The 
interpretation  structure  -  the  literal  (sentential)  semantic 
'ontent  of  the  utterance  -  is  then  processed  by  a  discourse  expert 
that  attempts  to  determine  what  was  really  meant.  In  this  process, 
anaphoric  expressions  must  be  resolved  and  indirect  speech  acts 
recognized.  Finally,  on  the  basis  of  what  is  determined  to  be  the 
intended  force  of  the  utterance,  the  discourse  component  decides 
how  the  system  should  respond.  It  plans  its  own  speech  or  display 
actions,  and  passes  'hern  off  to  the  language  generation  component 
no  yet  implemented!  or  display  expert.  Some  of  these  operations 
will  he  discussed  in  more  detail  in  Section  1. 

2.  The  Representation  Lanquaqe 

KLONE  is  a  uniform  language  for  the  explicit  representation  of 
conceptual  information  based  on  the  idea  of  structured  inheritance 
(Rra'hman,  i97R,  1979],  The  principal  representat ional 
elements  of  KLONE  are  Concepts,  of  which  there  are  two  major  types 
generic  and  Individual.  Generic  Concepts  are  arranged  in  an 
inheritance  structure,  expressing  long~term  generic  knowledge  as  a 
taxonomy.  A  single  Generic  Concept  is  a  description  template,  from 
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which  individual  descriptions  (in  the  form  of  Individual  Concepts) 
are  formed.  Generic  Concepts  can  be  built  as  specializations  of 
other  Generic  Concepts,  to  which  they  are  attached  by  inheritance 
Cables.  These  Cables  form  the  backbone  of  the  network  (a  Generic 
Concept  can  have  many  "superConcepts"  a*  wall  as  irany 
" subConcepts " )  .  They  carry  structured  descriptions  frc.n  a  Concept 
to  its  subConcepts. 

KLONE  Concepts  are  highly  structured  objects.  A  subConcept 
inherits  a  structured  definition  from  its  parent*  and  can  modify  it 
in  a  number  o;  structurally  consistent  ways.  The  main  elements  of 
the  si ructure  are  Roles,  which  cypress  relationships  between  a 
Concept  and  other  closely  associated  Concepts  (i.e,,  its 
properties,  parts,  etc.).  Roles  themselves  have  structure, 
including  descriptions  of  potential  fillers,**  modality 
information,  and  names. There  are  basically  two  kinds  of  Roles 
in  KLONE:  RoleSets  and  IRoles.  RoleSets  have  potentially  many 
fillers  and  may  carry  a  restriction  on  the  number  of  possible 

*  This  Inheritance  implies  inter  alia  t'h&T,"  I  f  ~ sfATE  1  s  a 
subConcept  of  ATN -CONSTITUENT ,  then  any  pa-  icular  state  is  by 
definition  also  an  ATN  constituent. 

**  These  limitations  on  the  form  of  particular  fillers  are  called 
"Value  Restrictions"  (V/R's),  If  more  than  one  V/R  is  applicable 
at  a  given  Role,  the  restrictions  are  taken  conjunctively. 

***  Names  are  not  used  by  the  system  in  any  way.  They  are  merely 
conveniences  for  the  user. 


Repo r t  No  .  4 1 Rp 


Bolt  Reranek  anti  Newman  Inc 


vice-president,  etc.;  this  is  a  relationship  betwet?n  HoleSets 
in  which  the  more  specific  Roles  inherit  all  properties  of 
the  parent  Role  except  for  the  number  restriction; 

-  particularization  (of  a  RoleSet  Cor  an  Individual  Concept); 
e.g.,  the  officers  of  RBN  are  all  COLLEGE  -GRADUATES ;  this  is 
the  relationship  between  a  RoleSet  n  n  Individual  Concept 
and  a  RoleSet  of  a  parent  Generic  Co.  pt . 

-  satisfaction  (binding  of  a  particular  filler  description  into 
a  particular  Role  in  an  Individual  Concept);  e.g.,  the 
president  of  RRN  is  STEVE-LEVY;  this  is  the  relationship 
between  an  IRole  and  its  parent  RoleSet. 


Fig.  2.  A  piece  of  a  KI.ONE  taxonomy. 
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Fiqure  2  illustrates  the  use  of  Cables  and  the  structure  of 
Concepts  in  a  piece  of  the  KLONE  taxonomy  for  the  ATN  grammar.  In 
this  figure,  Concepts  are  presented  as  ellipses  (Individual 
Concepts  are  shaded).  Roles  as  small  squares  (IRoles  are  filled 
in),  and  Cables  as  double-lined  arrows.  The  most  general  Concept, 
ATN -CONSTITUENT ,  has  two  subConcepts  -  STATE  and  ARC.  These  each 
inherit  the  general  properties  of  ATN  constituents,  namely,  each 
is  known  to  have  a  displayPora  associated  with  it.  The  subnetwork 
below  ARC  expresses  the  cl  ass i f i cat  ion  of  the  var  ious  types  of  arcs 
in  the  ATN  and  how  their  conceptual  structures  vary.  For  example, 
a  CONN  E  ‘T I NG -ARC  has  a  nextState  (the  state  in  which  the  transition 
leaves  the  parsing  process),  while  for  P^P-ARCs  the  term  is  not 
meaningful  (i.e,,  there  is  no  nextState  Role).  Links  that  connect 
the  Roles  of  more  specific  Concepts  with  corresponding  Roles  in 
their  parent  Concepts  are  considered  to  travel  through  the 
appropriate  Cables.  ’inally,  the  structure  of  an  Individual 
Concept  is  illustrated  by  CATARC  ♦£)  1 1  7 .  Each  IRole  expresses  the 
filling  of  a  Role  inherited  from  the  hierarchy  above  because 
CAT  ARf'  Id  1 1 7  is  a  CAT-ARC,  it  has  a  category;  because  it  is  also  a 
CONNECTING -ARC ,  it  has  a  nextState,  etc. 

The  structure  of  a  Concept  is  completed  by  its  set  of 
Structural  Descriptions  (SD’s).  These  express  how  the  Roles  of  the 
Concept  interrelate  via  the  use  of  parameter i zed  versions 
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( " Pa ra I nd i v idua 1 s " )  of  other  Concepts  in  the  network  to  describe 
quantified  relations  between  the  ultimate  fillers  of  the  Concept ' s 
Roles,  The  quant i f i cat  ion  is  expressed  in  terms  of  set  mappings 
between  the  RoleSets  of  a  Concept,  thereby  quantifying  over  their 
sets  of  fillers.  In  addition  to  quantified  relations  between 
potential  Role  fillers,  simple  relations  like  subset  and  3et 
equality  can  be  expressed  with  a  special  kind  of  SD  called  a 
" Ro 1 eVa 1 ueMap"  (°.g.,  the  relation  that  "the  object  of  the 
precondition  of  a  BEFing  action  is  the  sane  as  the  object  of  its 
effect")  .  SD's  are  inherited  through  cables  and  are  particularized 
In  a  manner  similar  to  that  of  Role;,. 

There  is  ^rie  important  feature  of  KLONF  that  in  worth  pointing 
out,  although  it  is  no*  yet  used  in  the  current  natural  language 
system.  The  language  carefully  list inguishes  between  purely 
rfescr ipt ional  structure  and  assertions  about  coreference, 
existence,  et  .  All  of  the  structure  mentioned  above  (Concepts, 
Roles,  BD '  s  and  Cables)  is  definitional.  A  separate  construct 
called  a  Nexus  is  a  used  as  a  locus  of  coreference  for  Individual 
r^ncepts.  One  expresses  coreference  of  description  relative  to  a 
Context  by  placing  a  Nexus  in  that  Context  and  attaching  to  it 
Individual  Concepts  considered  to  be  coreferent i al  .  All  assertions 
are  made  relative  to  a  Context,  and  thus  do  not  affect  the 
(descriptive)  taxonomy  of  generic  knowledge.  We  anticipate  that 
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Nexuses  will  be  important  in  reasoning  about  particulars,  answering 
questions  {especially  in  deciding  the  appropriate  form  for  an 
answer),  and  resolving  anaphoric  expressions;,  and  that  Contexts 
will  be  of  use  in  reasoning  about  hypothet  i  cal  s ,  beliefs,  and 
wants . 


The  final  feature  of  KLQNE  relevant  to  our  discussion  Is  the 
ability  to  attach  procedures  and  data  to  structures  in  the  network. 
The  attached  procedure  mechanism  is  implemented  in  a  very  general 
way.  Procedures  are  attached  to  KLONE  entities  by  "interpretive 
hooks"  (Shooks)  ,  which  specify  the  set  of  situations  in  which  they 
are  to  be  triggered.  An  interpreter  function  operating  on  a  KLONE 
entity  causes  the  invocation  of  ail  procedures  inherited  by  or 
directly  attached  to  that  entity  by  ihooks  whose  situations  match 
the  intent  of  rhat  function.  Situations  include  things  like 
"Individuate",  "Modify",  "Create",  "Remove",  etc.  In  addition  to  a 
general  situation,  an  Shook  specifies  when  in  the  execution  of  the 
interpreter  function  it  is  to  be  invoked  { PRF - ,  POST-,  or  WHEN-). 

3,  Use  of  KLONK  in  the  Natural  Language  System 

As  mentioned  previously,  KLHNE  is  used  in  several  places  In 
our  language  understanding  system  -  these  include  the  syntactic 
taxonomy  used  to  constrain  parsing  and  to  index  semantic 
interpretation  rules,  and  the  structures  used  in  th 
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svntaet i cfdi scour se  interface  to  express  the  literal  semantic 
content  of  an  utterance.  The  parser  uses  KLnNE  to  describe 
potential  syntactic  structures.  A  taxonomy  of  syntactic 
constituent  descriptions,  with  Concepts  like  PHRASE ,  noun -PHRASE, 
L00AT ION -PP,  and  PFRSON-WORP,  is  used  to  express  bow  phrase,  are 
built  from  their  constituents.  The  taxonomy  also  serves  as  a 
discrimination  net,  allowing  common  features  of  constituent  types 
to  be  expressed  in  a  single  place,  and  distinguishing  feature,  to 
cause  branching  into  separate  subnets. 

Two  benefits  accrue  from  this  organisation  of  knowledge. 
First,  .hallo,  semantic  constrain.,  are  expressed  in  the  Roles  and 
Sti's  of  Concepts  like  LOCATION-PP.  For  example,  the  pr.pObj.ct  of  a 
LOCATION-PP  must  be  a  PLACE -NOUN,  A  description  of  "on  A!"  las  In 
•book  on  AI‘I  as  a  LOCATION-PP  could  not  be  constructed  sine.  AI 
does  not  satisfy  the  value  restriction  for  the  h..d  role.  such 
constraints  help  rule  out  misleedlng  parse  paths,  in  the  manner  of 
»  semantic  grammar  (Burton,  1R7M,  by  refusing  to  construct 
semantically  anomalous  constituent  descriptions.  In  conjunction 
With  the  general  (ATN)  gramma,  of  English,  this  Is  ,  powerful 
guidance  mechanism  which  help,  parsing  proceed  close  t0 
deters  fn i st  Sea  1 1 y  (Bobrow,  1978). 

Second,  the  syntactic  taxonomy  server  as  a  structure  on  which 
to  hang  semantic  projection  rul.s,  since  th,  taxonomy  is 
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inheritance  structure,  the  description  of  a  given  syntactic 
constituent  inherits  all  semantic  interpretation  rules  appropriate 
for  each  of  the  more  general  constituent  types  that  it  specializes, 
and  can  have  its  own  special-purpose  rules  as  well.  In  the  example 
above,  simply  by  virtue  of  its  placement  in  the  taxonomy,  the 
Concept  for  “on  M"  would  inherit  rules  relevant  to  prepositional 
phrases  in  general  and  to  SUBJECT-PP's  in  particular,  but  not  those 
appropriate  to  LQCATION-PP ' s.  Interpretation  per  se  is  achieved 
using  the  attached  procedure  facility,  with  semantic  projection 
rules  expressed  as  functions  attached  to  Roles  of  the  syntactic 
Concepts.  The  functions  specify  how  to  translate  pieces  of 
syntactic  structure  into  "deeper"  Concepts  and  Roles.  For  example, 
the  subject  of  a  SHOW -PH PARE  might  map  into  the  agent  of  a  DISPLAY 
action. 

The  mapping  rules  are  triggered  automatically  by  the  KLONE 
interpreter.  This  is  facilitated  by  the  interpreter’s  "pushing 
down"  a  Concept  to  the  most  specif ic  place  it  can  be  considered  to 
belong  in  the  taxonomy  (using  only  "analytic",  definitional 
constraints) .  Figure  3  illustrates  schematically  the  way  a  Concept 
can  descend  to  the  most  specific  level  implied  by  its  internal 
description.  The  Concept  being  added  to  the  network  is  an  NP  whose 
head  is  "ARC"  and  whose  modifier  is  "PUSH*  (NP00023).  It  is 
initially  considered  a  direct  (Generic)  subConcept  of  the  Concept 
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Fig.  3.  Automatic  concept  descent. 


for  its  basic  syntactic  type  (NP)  .  Its  Role  structure,  however, 
implies  that  it  in  fact  belongs  in  a  more  restricted  subclass  o£ 
NP's,  that  is,  TYPED-ARr -NP  (an  NP  whose  head  is  an  ARC-NOUN  and 
whose  Modifier  is  an  ARC-TYPE -WORD )  .  The  interpreter,  on  the  basis 
of  only  definitional  constraints  expressed  in  the  network,  places 
the  new  Concept  below  its  “most  specific  subsumer"  —  the  proper 
place  for  it  in  the  taxonomy.  The  process  proceeds  incrementally, 
with  each  new  piece  of  the  constituent  possibly  causing  further 
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descent.  In  this  case,  NP£0023  would  initially  only  have  its  head 
Role  specified,  and  on  that  basis,  it  would  be  placed  under  ARC-NP 
(which  is  "an  NP  whose  heed  is  an  ARC-NOUN")  .  Then  the  parser 
would  add  the  modifier  specification,  causing  the  Concept's  descent 
to  the  resting  place  shown  in  the  right  half  of  Figure  3.  When  the 
constituent  whose  description  is  being  added  to  the  network  is 
"popped"  in  the  parser,  its  KLONE  description  is  individuated  -- 
causing  the  invocation  of  all  "WHEN-Ind iv  iduated"  attached 
procedures  inherited  through  superConcept  Cables.  These  procedures 
cause  an  interpretation  for  the  constituent  to  be  built  on  the 
basis  of  the  interpretations  of  component  parts  of  the  syntactic 
descr ipt ion . 

The  literal  semantic  interpretation  of  a  phrase  produced  by 
semantic  interpretation  -  also  a  KLONF  structure  -  is  the  "input" 
to  the  discourse  component.  An  important  olenent  of  this  interface 
between  the  syntactic  processor  and  the  discourse  component  is  that 
the  par ser/ interpreter  commits  itself  only  to  information 
explicitly  present  in  the  input  phrase,  and  leaves  all  inference 
about  quantifier  scope,  etc.  to  the  discourse  expert.  Two  kinds  of 
representational  structures  support,  this.  The  Concept  DSET  (for 
•determined  set")  is  used  extensively  to  capture  sets  implicit  in 
noun  phrases  and  clauses.  DSETs  use  the  inherent  multiplicity  of 
RoleSets  to  group  together  several  entities  under  a  single  Concept, 
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and  to  associate  determiners  ( def in i te/ inde £ ini fe ,  quantifiers, 
etc.)  with  such  a  set  of  entities.  The  former  is  accomplished 
using  a  single  member  RoleSet  whose  multiplicity  is  open-ended 
(between  3  and  infinity);  the  latter  is  achieved  by  simply  having  a 
determiner  RoleSet  whose  number  Is  restricted  to  be  1.  A  DSET  can 
express  the  characteristics  of  a  set  of  entities  without 
enumerating  them  explicitly,  or  even  indicating  how  many  members 
the  set  is  expected  to  have.  RoleVal ueMaps  allow  constraints 
between  OSETs  to  be  expressed  in  a  general  way  -  a  RoleValueMap 
expresses  a  subset  or  equality  relation  between  two  RoleSets.  Such 
relations  can  be  constructed  without  knowing  in  advance  the 
cardinality  of  the  sets  or  any  of  their  members. 

Figure  4  illustrates  the  use  of  these  structures  to  express 
the  intent  of  the  sentence,  “Show  me  states  S/NP,  5/AUX,  and 
S/DCL. “•  DSETI303S  represents  the  interpretation  of  the  noun 
phrase,  “the  states  S/NP,  S/AUX,  and  S/DCL".  The  generic  DSET 
Concept  has  two  Roles,  member  and  determiner.  The  member  Role  can 
be  filled  multiply,  and  therein  lies  the  “settedness*  of  the  DSET. 
DSET#B035  has  a  particularized  version  of  the  member  Pole:  Role  Rl 
represents  the  set  of  three  states  mentioned  in  the  noun  phrase,  as 

r  RoleSets  1  n  th  1  s  TTg  ure  a  re  cFrawn  as  squares  with  c  1  Teles'  around 
them.  RoleSets  with  £illed-in  circles  are  a  special  kind  of 
particular ized  RoleSet  that  can  occur  only  in  Individual  Concepts. 
The  RoleValueMap  is  pictured  as  a  diamond. 
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Fig.  4.  KLONE  description  of 
Show  me  states  5/NP,  S/AUX,  and  S/DCL" 


a  group.  Thus,  the  Value  Restriction  of  R 1 ,  STATE,  applies  to  each 
member.  The  three  IRoles  of  CPETI0035,  connected  by  “Satisfies" 
links  to  the  particularized  mcaber  RoleSet,  Indicate  that  the 
particular  states  are  the  members  of  the  set.* 


The  Value  Restriction,  STATE,  Is  redundant  here,'  since  'the 
members  of  this  particular  set  were  explicitly  specified  (and  are 
known  to  be  states).  In  other  cases,  the  information  is  more 
useful.  For  example,  no  IRoles  would  be  constructed  by  the  parser 
if  the  sentence  were  "Are  there  three  states?"?  only  one  would  be 
constructed  in  "Show  me  state  S/NP  and  its  two  nearest  neighbors". 
On  the  other  hand,  no  Value  Restriction  would  be  directly  present 
on  Role  Rl  if  the  noun  phrase  were  just  "S/NP,  5/AUX,  and  S/DCL*. 
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The  other  DSET  in  the  figure,  DSET*0flV>,  represents  the 
clause-level  structure  of  the  sentence.  The  clause  has  been 
interpreted  into  something  like  "the  user  has  performed  what  looks 
on  the  surface  to  be  a  request  for  the  system  to  show  the  user  some 
set  of  states'*. 


This  captures  several  kinds  of  indeterminacy:  (1)  that  the 
sentence  may  only  be  a  request  at  the  surface  level  {"Don't  you 
know  that  pigs  can't  fly?"  looks  like  a  request  to  inform),  (2) 
that  there  is  more  than  one  way  to  effect  a  "show"  {"show"  could 
mean  redraw  the  entire  display,  change  it  slightly  to  include  a  new 
object,  or  simply  highlight  an  existing  one),  (3)  that  it  is  not 
clear  how  many  operations  are  actually  being  requested  (showing 
three  objects  could  take  one,  two,  or  three  actions).  Therefore, 
the  interpretation  uses  Generic  Concepts  to  describe  the  kind  of 
events  appearing  in  the  surface  form  of  the  sentence  and  makes  no 
commitment  to  the  number  of  them  requested.  The  only  commitment  to 
quant i f Scat  ional"  information  is  expressed  by  the  RoleVal ueMap. 
Its  two  pointers,  X  (pointing  to  the  meeiber  Role  of  DSETI0035)  and 
Y*  {P°Sntin9  to  the  object  cf  the  requested  act),  indicate  that  the 


^J"Ter  *oIng  flrst  through  The”  meiBeT  ~RoTe~~o7 
f « fill  V  ^en  *hrou9h  the  of  S-REQUESTM018,  and 

►k  object  Role  of  SHQW@i@36.  It  is  considered  to 
reter  to  the  set  of  IRoles  expressing  the  objects  of  all  SHOW 


events  ultimately  S 
many  there  are  to 
finally  specified) . 


■REQUESTed,  when  it  is  determined  exactly  how 
be  (i.e„  when  the  IRoles  of  DSETI0037  are 
Thus,  if  there  are  ultimately  two  SHOWg,  one 
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ult'^ate  set  of  things  to  he  shown,  no  matter  how  many  particular 
SHOW  events  take  place,  must  be  the  same  as  the  set  of  members  in 
the  noun  phrase  DSET  (namely,  the  three  states). 

Given  the  Input  from  semantic  interpretation,  the  discourse 
expert  looks  for  a  plan  that  it  can  hypothesize  its  user  to  be 
following,  in  order  to  interpret  indirect  speech  acts.  Following 
[Allen,  1979],  the  speech  acts  REQUEST,  INFORM,  l NFORHREF ,  and 
INFORMIF  are  defined  as  producing  certain  effects  by  means  of  the 
hearer's  recognition  of  the  speaker's  intention  to  produce  these 
effects.  Indirect  speech  act  recognition  proceeds  by  inferring 
what  the  user  wants  the  system  to  think  is  his/her  plan. 
Plan- recogni t ion  involves  making  inferences  of  the  form,  "the  user 
did  this  action  in  order  to  produce  that  effect,  which  s/he  wanted 
in  order  to  do  this  (next)  action". 

Making  inferences  at  the  level  of  "intended  plan  recognition" 
is  begun  by  analyzing  the  user's  utterance  as  a  "surface*  speech 
act  (SURFACE-REQUEST  or  SURFACE  - 1 NFORM)  indicating  what  the 
utterance  "looks  like".  Ry  performing  pi  an- recogn 1 1  ion  inferences 
whose  plausibility  is  ascertained  by  using  mutual  beliefs,  the 
system  can,  for  instance,  reason  that  what  looked  to  be  an  INFORM 
of  the  user's  goal  is  actually  a  REQUEST  to  include  some  portion  of 

ot  one  state  an3  Fhe  other  oPTwo,  Vhe  IT  po inter  imp!  ic  1  tTy  reTeri 
to  the  set  of  all  three  states  shown. 
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th*  ATN  lnto  th<?  display.  Thus,  the  second  clause  of  the 
utterance,  "No;  I  want  to  be  able  to  see  S/AUX,"  is  analyzed  as  a 
REQUEST  to  INCLUDE  S/AUX  by  the  following  chain  of  plan-recognition 
i nferenees ; 

The  system  believes 

1)  The  user  has  performed  a  SURFACE-INf orm  of  his/her  qoali 
thus  ’ 


21  The  user  intends  for  the  system 
wants  to  be  able  to  see  S/AUX. 
S/ AUX  be  visible, 


to  believe  that  the  user 
Since  this  requires  that 


3)  The  user  intends  for 
wanrs  the  system  to 
Because  the  "No" 
miqht  want  to  modify 
INCLUDE  S/AUX  in 
DISPLAY  S/AUX  a  1  one , 


the  system  to  believe  that  the  user 
plan  an  action  to  make  S/AUX  visible, 
leads  to  an  expectation  that  the  user 
the  display,  the  system  plans  to 
the  existing  display,  rather  than 


4)  Hence ,  rhe  user  intends  for  the  system  to  believe  that 
user  wants  the  system  to  INCLUDE  S/AUX. 


The  user  has  pet  formed  a  REQUEST  to  INCLUDE. 
The  system  responds  by  planning  that  action. 


In  addition  to  using  Contexts  to  hold  desciiptions  of  beliefs 
and  wants,  the  plan-recognition  process  makes  extensive  use  of 
RoleVal ueMaps  and  DSETs  (see  Figure  45.  Plan- recogni t ion 
inferences  proceed  using  just  the  clause-level  structure  and  pay  no 
at*ention  to  the  particulars  of  the  noun  phrase  interpretations. 
Tne  system  creates  new  DSETs  for  intermediate  sets  and  equates  then 
to  previous  ones  by  RoleValueMaps,  as,  for  example,  when  it  decides 
to  do  a  show  whose  object  is  to  be  the  same  as  whatever  was  to  be 
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visible.  At  the  end  of  pi  an- recogn  i  t  ion  the  system  may  need  to 
trace  through  the  constructed  Ro  1  eVa  1  ueMaps  to  find  all  sets 
equivalent  to  a  given  one.  For  instance,  when  it  determines  that, 
it  needs  to  know  which  set  of  things  to  display,  highlight,  or 
include,  it  treats  the  equated  Rol eVal ueMaps  as  a  set  of  rewrite 
rules,  traces  back  to  the  original  noun  phrase  DSET,  and  then  tries 
to  find  the  referent  of  that  DSET.* 

Finally,  not  only  are  parse  structures  and  semantic 
interpretation  represented  in  KLONF.,  but  the  data  base  -  the  ATN 
being  discussed  -  is  also  represented  as  KLONE  structure  (see 
Figure  2,  above).  Further,  descriptions  of  how  to  display  the  ATN, 
and  general  descriptions  of  coordinate  mappings  and  other  display 
information  are  represented  in  KLONF  too.  Commands  to  the  display 
expert  are  expressed  as  Concepts  involving  actions  like  SHOW, 
CE'ITER,  etc.  whose  "arguments"  are  descriptions  of  desired  shapes, 
etc.  Derivations  of  particular  display  forms  from  generic 
descriptions,  or  from  napping  changes,  are  carried  out  by  the 
attached  procedure  mechanism.  Finally,  once  the  particular  shapes 
are  decided  upon,  drawing  is  achieved  by  invoking  "how  to  draw* 
procedures  attached  to  display  form  Concepts.  Once  again,  the 

r  The  system  onTy  fines'  refer enTs~wTien  necessary.  Thi  s  Je"pen<T5Ton 
the  user's  speech  acts  and  the  system's  needs  in  understanding  and 
complying  with  them.  Thus,  it  is  intended  that  a  naming  speech 
act  like  "Call  that  the  complement  network"  will  not  cause  a 
search  for  the  referer.t  of  "the  complement  network". 
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taxonomic  nature  of  the  structured  inheritance  net  allows  domain 
structure  to  be  expressed  in  <t  natural  and  useful  way. 
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